Image file reproduction device and image file reproduction method

ABSTRACT

A method of reproducing an image file from a recording medium that stores an image file of a first type and/or an image file of a second type includes reproducing the first type of image file or second type of image file, detecting whether each of a predetermined number of image files stored on the recording medium is the first type of image file or the second type of image file during the reproduction of an image file, and converting the second type of image file to the first type of image file by reading the main image data from the second type of image file, generating display-image data (image data for display use) based on the read main image data, and storing the generated display-image data in the original image file if the image file is determined to be the second type of image file based on the detection result. The first type of image file is an image file containing a header, main image data, and display-image data, and storing the display-image data in an area other than an area storing the header. The second type of image file is an image file containing a header and main image data, and storing no display-image data in an area other than an area storing the header. The image files of predetermined number being image files that can be reproduced when reproduction is done in the forward and/or reverse direction from the image file being reproduced.

This is a Rule 1.53(b) Continuation of application Ser. No. 12/255,921,filed Oct. 22, 2008

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a device for processing image file,such as reproduction and transmission of image files, and moreparticularly to a device for reproducing an image file including imagedata for display use in addition to main image data.

2. Related Art

JP-A-2006-005952 teaches a digital still camera (referred to simply a“digital camera” below) that creates an image file storing image datafor display use (referred to as “display-image data”) other than athumbnail image data.

This digital camera creates preview image data and thumbnail image data(160 horizontal dots×120 vertical dots, for example) from the capturedimage data (1920 horizontal dots×1440 vertical dots, for example). Thepixel count (the number of pixels) of the preview image data matchesthat of the liquid crystal display (LCD) monitor on the digital camera(320 horizontal dots×240 vertical dots, for example). The thumbnailimage data is data used for displaying thumbnails on the LCD of thedigital camera. The digital camera manages the captured image data, thepreview image data, and the thumbnail image data in the same image file.

This enables the digital camera to instantly display a preview image orthumbnail images on the LCD.

An advantage of storing display-image data other than the thumbnailimage data in the image file is that either image can be displayedinstantly. A disadvantage, however, is that because multiple versions ofthe same image data are contained in the image file, the processes forgenerating, reproducing, and transmitting the image files arecomplicated, and that because the size of the image file increases, theprocess including transmission takes longer. As a result, an image fileprocessing device that is sufficiently easy to use cannot be provided bysimply storing display-image data in the image file.

SUMMARY OF THE INVENTION

The present invention is directed to solving the foregoing problem andprovides a user-friendly and easy-to-use image file processing devicethat generates, reproduces, and transmits image files storingdisplay-image data which is not thumbnail image data.

An image file reproduction device according to the invention is areproduction device for reproducing an image file from a recordingmedium storing an image file of a first type and/or an image file of asecond type. The first type of image file is an image file whichcontains a header, main image data, and display-image data which isimage data for display use, and stores the display-image data in an areaother than an area storing the header. The second type of image file isan image file which contains a header and main image data, and stores nodisplay-image data in an area other than an area storing the header.

The reproduction device includes: a reproduction unit that can reproducethe first type of image file and second type of image file; a detectorthat detects whether each of a predetermined number of image filesstored on the recording medium is the first type of image file or thesecond type of image file while the reproduction unit reproduces animage file; and an image file converter that converts the second type ofimage file to the first type of image file by reading the main imagedata from the second type of image file, generating display-image databased on the read main image data, and storing the generateddisplay-image data in the original image file when the image file isdetected to be the second type of image file based on the detectionresult. The image files of predetermined number are image files that canbe reproduced when reproduction is done in the forward and/or reversedirection from the image file being reproduced.

An image file reproduction method according to the invention is a methodfor reproducing an image file from a recording medium storing an imagefile of a first type and/or an image file of a second type. The firsttype of image file is an image file which contains a header, main imagedata, and display-image data which is image data for display use, andstores the display-image data in an area other than an area storing theheader. The second type of image file is an image file which contains aheader and main image data, and stores no display-image data in an areaother than an area storing the header. The reproduction method includes:reproducing the first type of image file and second type of image file;detecting whether each of a predetermined number of image files storedon the recording medium is the first type of image file or the secondtype of image file while reproducing the image file; converting thesecond type of image file to the first type of image file by reading themain image data from the second type of image file, generatingdisplay-image data based on the read main image data, and storing thegenerated display-image data in the original image file when the imagefile is detected to be the second type of image file based on thedetection result. The image files of predetermined number are imagefiles that can be reproduced when reproduction is done in the forwardand/or reverse direction from the image file being reproduced.

The invention can thus prepare display-image data for the image fileslocated before and after the currently displayed image file, and thusenables rapidly reproducing forward and back while displaying theimages.

Other possible aspects of the invention are described below.

(1) A first image file generation device according to the invention mayhave main image data acquisition means for acquiring main image data;display-image data generating means for generating display-image databased on the main image data or image data which is source data of themain image data; and image file generating means for generating an imagefile. The image file includes a header, main image data, anddisplay-image data, and stores the display-image data in an area otherthan the header. The header stores information relating to thedisplay-image data. With this arrangement, the display-image data can beinterpreted by simply reading information related to the display-imagedata stored in the header. Thus the display-image data can be quicklysearched.(2) A second image file generation device according to the invention mayinclude main image data acquisition means for acquiring main image data;display-image data generating means for generating display-image databased on the main image data or image data which is source data of themain image data; image file generating means for selectively generatinga first type of image file or a second type of image file; and file typeselection means for instructing the image file generating means togenerate the first type of image file or second type of image file. Thefirst type of image file is an image file that includes a header, mainimage data, and display-image data, and stores the display-image data inan area other than the header. The second type of image file is an imagefile that has a header and main image data, but stores no display-imagedata in an area other than an area storing the header. This enablesgenerating image files as desired by the user.(3) A third image file generation device according to the invention mayinclude main image data acquisition means for acquiring main image data;display-image data generating means for generating display-image databased on the main image data or image data which is source data of themain image data; and image file generating means for generating an imagefile. The image file includes a header, main image data, anddisplay-image data, and stores the display-image data in an area otherthan the header. The image file can store plural pieces of display-imagedata, and the plural pieces of display-image data are stored in apredetermined order in the image file. In this manner, the plural piecesof display-image data are stored in a predetermined order, and thussearching is made easier.(4) A fourth image file generation device according to the presentinvention may include main image data acquisition means for acquiringmain image data, display-image data generating means for generatingdisplay-image data based on the main image data or image data which issource data of the main image data, and image file generating means forgenerating an image file. The image file includes a header, main imagedata, and display-image data, and stores the display-image data in anarea other than the header. The main image data acquisition means canacquire a plurality of main image data through continuous shooting.After the main image data acquisition means finishes acquiring pluralpieces of main image data through a series of the continuous shooting,the image file generating means starts generation of image file for eachpiece of the main image data. Thus, the processing power of thecontroller can be concentrated on acquiring process of the main imagedata during the continuous shooting. Accordingly, the load on theprocessor by processes other than main image data acquisition can bereduced while taking continuous shooting, and thus the continuousshooting operation can be done at high speed.(5) A fifth image file generation device according to the presentinvention may include main image data acquisition means for acquiringmain image data; setting means that sets pixel count of thedisplay-image data, display-image data generating means for generatingdisplay-image data according to the setting from the setting means basedon the main image data or image data which is source data of the mainimage data, and image file generating means for generating an imagefile. The image file includes a header, main image data, anddisplay-image data, and stores the display-image data in an area otherthan the header. As a result, the pixel count of the display-image datacan be set as desired. The user can therefore generate an image filestoring display-image data of the desired size.

The fifth image file generation device may also have a communicationmeans for communicating with a display device for displaying thedisplay-image data, and a data acquisition means for acquiring pixelcount of the display device through the communication means. The settingmeans may set the pixel count of the display-image data according to theacquired pixel count information. With this arrangement, the pixel countof the display-image data can be set automatically, and thus there is noneed for the user to set the pixel count, improving user convenience.

(6) A sixth image file generation device according to the presentinvention may include main image data acquisition means for acquiringmain image data; display-image data generating means for generatingdisplay-image data based on the main image data or image data which issource data of the main image data; and image file generating means forgenerating an image file. The image file includes a header, main imagedata, and display-image data, and stores the display-image data in anarea other than the header. The display-image data generating means cangenerate display-image data with a different aspect ratio than that ofthe main image data. As a result, the aspect ratio of the display-imagedata can be set as desired, and the user can generate an image filestoring display-image data with the desired aspect ratio.(7) A seventh image file generation device according to the presentinvention includes main image data acquisition means for acquiring mainimage data; display-image data generating means for generatingdisplay-image data based on the main image data or image data which issource data of the main image data; and image file generating means forgenerating an image file. The image file includes a header, main imagedata, and display-image data, and stores the display-image data in anarea other than the header. The image file can store plural pieces ofdisplay-image data. The plural pieces of display-image data stored inthe image file have different aspect ratios. With this arrangement,display-image data of different aspect ratios are stored in a singleimage file, and thus the suitable display-image data can be read andreproduced according to the reproduction status.(8) An eighth image file generation device according to the presentinvention may include main image data acquisition means for acquiringmain image data; generating method selection means for setting one ofplural display-image data generating methods that are used forgenerating the display-image data; display-image data generating meansfor generating display-image data based on the main image data or theimage data which is source data of the main image data according to theset generating method; and image file generating means for generating animage file. The image file includes a header, main image data, anddisplay-image data, and stores the display-image data in an area otherthan the header. As a result, the method of converting the aspect ratioof the display-image data can be set as desired, and the user cantherefore generate an image file storing the desired display-image data.

In the eighth image file generation device, the display-image datagenerating means can use a plurality of generating methods to generate,from the main image data, display-image data with different aspect ratiothan that of the main image data, and the generating method selectionmeans can set one of the plural methods to be used for generating thedisplay-image data. As a result, the method of converting the aspectratio of the display-image data can be set more easily.

(9) The ninth image file generation device of the invention may includemain image data acquisition means for acquiring main image data,display-image data generating means for generating display-image datawith a different aspect ratio than the aspect ratio of the main imagedata by generating an effective image area based on the main image dataor the image data which is source data of the main image data accordingto a predetermined method and combining the effective image area andno-image-signal area; and an image file generating means for generatingan image file that includes a header, main image data, and display-imagedata, and stores the display-image data in an area other than theheader. The image file generating means stores identificationinformation identifying the effective image area in the header. Withthis arrangement, information identifying the effective image area isstored in the header, and the effective image area can be extracted fromthe display-image data by referring to the information. As a result, theinvention can be used with processes that use only the data in theeffective image area, such as when printing.(10) A tenth image file generation device according to the presentinvention may include main image data acquisition means for acquiringmain image data, image rotation command receiving means for receiving acommand to rotate the main image data, display-image data generatingmeans for generating rotated display-image data based on the main imagedata or the image data which is source data of the main image data byrotating it according to the rotate command when the image rotationcommand receiving means receives a rotate command, image file generatingmeans for generating an image file when the image rotation commandreceiving means receives a rotate command. The image file includes aheader storing rotation information indicating the rotate command, themain image data that is not rotated, and the display-image data that isrotated, and stores the display-image data in an area other than theheader. With this arrangement, the display-image data which is rotatedis stored in the image file, and thus it is not necessary to rotate thedisplay-image data when the display-image data is reproduced. Thedisplay-image data can therefore be reproduced rapidly.

In the tenth image file generation device, the display-image datagenerating means may change the pixel count of the rotated display-imagedata according to the angle of rotation indicated by the rotate command.As a result, the display-image data can be generated in a size suitableto the display when the display-image data is first generated.

In the tenth image file generation device, when a rotate command forrotating display-image data with a landscape orientation todisplay-image data in a portrait orientation is received, thedisplay-image data generating means may change the pixel count of thedisplay-image data after rotation so that the vertical pixel count ofthe display-image data in portrait orientation equals the vertical pixelcount of the display-image data in landscape orientation. The portraitimage is thus sized to fit in the display screen, and thus it is notnecessary to change the pixel count again when reproducing thedisplay-image data in the portrait mode.

(11) A image file editing device according to the present invention mayinclude an image file acquisition means for acquiring an image file, theimage file including a header, main image data, and display-image dataand storing the display-image data in an area other than the header;image rotation command receiving means for receiving a command to rotatethe main image data; display-image data generating means for generatingrotated display-image data according to the rotate command when theimage rotation command receiving means receives a rotate command, andimage file changing means for storing rotation information indicatingthe rotate command in the header and storing in the image file thedisplay-image data after rotation instead of or in addition to thedisplay-image data before rotation when the image rotation commandreceiving means receives a rotate command. With this arrangement, evenafter the image file is generated, the processor load in reproducingprocess of the rotated display-image data can be reduced by rotating thedisplay-image data and storing the rotated display-image data in theimage file.

In the image file editing device according to the present invention, thedisplay-image data generating means may generate the rotateddisplay-image data based on the main image data or the image data whichis source data of the main image data. As a result, degradation of therotated display-image data can be prevented.

(12) A first image data transmission device according to the presentinvention may include communication means that can communicate with anexternal device; data acquisition means for acquiring a command from theexternal device; storage means for storing an image file, the image fileincluding a header, main image data, plural pieces of display-image datagenerated based on the main image data or image data which is sourcedata of the main image data and storing the display-image data in anarea other than the header; extraction means for extracting one piece orplural pieces of display-image data from the image file according to acommand from the external device; and transmission means for sending theextracted image data through the communication means. As a result, it ispossible to send display-image data with pixel count matching theexternal device to which the image data is sent.(13) A second image data transmission device according to the presentinvention may include a communication means that can communicate with anexternal device; data acquisition means for acquiring a command from anexternal device; storage means that stores an image file, the image filecontaining a header, main image data, and one piece or plural pieces ofdisplay-image data generated based on the main image data or image datawhich is source data of the main image data and storing thedisplay-image data in an area other than the header; extraction meansfor extracting the main image data and one piece or plural pieces ofdisplay-image data from the image file according to a command acquiredfrom the external device, and a transmission means for transmitting theextracted image data through the communication means. As a result, themain image data is transmitted when display-image data with a pixelcount suitable to the destination external device is not stored in theimage file. Thus, the problem that image data can not be sent to theexternal device can be prevented.

In the first or second image data transmission device, the command fromthe external device may be an instruction related to the pixel count ofthe external device. As a result, display-image data with a pixel countsuitable to the destination external device can be transmitted.

In the first or second image data transmission device, the command fromthe external device may indicate the type of external device. As aresult, display-image data with a pixel count suitable to thedestination external device can be transmitted.

(14) A third image data transmission device according to the presentinvention may include a communication means that can communicate with anexternal device; a transmission command acquisition means for acquiringa command for transmission of display-image data from the externaldevice; storage means for storing an image file, the image fileincluding a header, main image data, and plural pieces of display-imagedata generated based on the main image data or image data which issource data of the main image data, and storing the display-image datain an area other than the header; extraction means for extracting thedisplay-image data with the highest pixel count among the plural piecesof display-image data from the image file according to the commandacquired from the external device; and transmission means fortransmitting the extracted image data through the communication means.(15) An image file transmission device according to the presentinvention may include a communication means that can communicate with anexternal device; a data acquisition means for acquiring a command fromthe external device; storage means for storing an image file, the imagefile including a header, main image data, and plural pieces ofdisplay-image data generated based on the main image data or image datawhich is source data of the main image data, and storing thedisplay-image data in an area other than the header; and transmissionmeans for transmitting the image file with the display-image dataremoved through the communication means according to the commandacquired from the external device. As a result, even if the destinationexternal device is not compatible with an image file storingdisplay-image data, the image file can be handled by the external devicebecause the image file is transmitted after converted to a filecontaining no display-image data.

In the image file transmission device according to the presentinvention, the command from the external device may indicate whether theexternal device can handle image files containing display-image data.

(16) An eleventh image file generation device according to the presentinvention may include a main image data acquisition means for acquiringmain image data; display-image data generating means for generatingdisplay-image data based on the main image data or image data which issource data of the main image data according to setting set in advanceor selectively for generating display-image data so as to fit inside apixel area having a predetermined aspect ratio and predeterminedvertical and horizontal pixel counts; and an image file generating meansfor generating an image file. The image file includes a header, mainimage data, and display-image data, and stores the display-image data inan area other than the header. The display-image data generating meanscan generate the display-image data with the same aspect ratio as themain image data while also fitting in the pixel area even if the aspectratio of the main image data differs from the aspect ratio of thesetting.

As a result, even if the aspect ratio of the main image data differsfrom the aspect ratio in the setting, display-image data can begenerated without changing the composition of the main image and withoutadding extra data. If it is configured to insert black areas when theaspect ratio of the main image data differs from the aspect ratio in thesetting, the black area may possibly be inserted into an area which isessentially needed. If it is configured to crop the top and bottom ofthe main image data to generate the display-image data in the same case,a part of the effective pixel area may possibly be deleted. Thus thecomposition of the display-image data may differ from that of the mainimage data. To the contrary, the invention enables generation ofdisplay-image data without changing the composition of the main imageand without adding extra data, and the size of the display-image data isnot increased unnecessarily. In addition, when the image data is sent toan external device such as a printer only requiring the essentiallynecessary part of the image, the external device does not need toexecute a process for removing unnecessary parts from the display-imagedata. In the eleventh image file generation device according to thepresent invention the display-image data generating means generates thedisplay-image data with the highest pixel count that will fit in thepixel area. As a result, the display-image data can be generated withthe highest resolution without changing the format of the main image andwithout adding extra data.

In the eleventh image file generation device according to the presentinvention, the display-image data generating means may generate thedisplay-image data so that the display-image data has the largest pixelcount while fitting in the pixel area.

In the eleventh image file generation device according to the presentinvention, the display-image data generating means may generate thedisplay-image data so that either the vertical or horizontal pixel countof the display-image data is the same as the vertical or horizontalpixel count of the pixel area.

(17) A twelfth image file generation device according to the presentinvention may include main image data acquisition means for acquiringmain image data; display-image data for generating display-image databased on the main image data or image data which is source data of themain image data; and image file generating means for generating an imagefile. The image file includes a main header, main image data, adisplay-image header and display-image data, and stores thedisplay-image data in an area other than an area storing the mainheader. The main header stores main image information that is imageinformation related to the main image data, and first display-imageinformation that is image information related to the display-image data.The display-image header stores second display-image information that isimage information related to the display-image data. The main imageinformation and the second display-image information share at least oneitem (type) of image information. The items (types) of image informationincluded in the first display-image information are different from theitems of image information included in the second display-imageinformation.

Since at least one item of image information included in the main imageinformation and the second display-image information is the same, thesecond display-image information can be stored in the header of a newimage file without greatly changing the second display-image informationwhen the main image and display-image are separated and stored indifferent image files. In addition, the items of image information inthe second display-image information and the items of image informationin the first display-image information are different, and thusinformation sufficient to manage the display-image data can be stored inthe first display-image information. As a result, the display-image datacan be searched quickly and reliably.

According to the invention, during display of image file, display-imagedata can be provided in advance for image files stored before and afterthe image file being displayed. Thus, image feed operation in forwardand/or back direction during image reproduction can be done rapidly.Accordingly, the invention can provide a user-friendly and easy-to-useimage file reproduction device.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing the configuration of a digital cameraaccording to a preferred embodiment of the present invention.

FIG. 2 shows the back of the digital camera according to a preferredembodiment of the present invention.

FIG. 3 shows the data structure of a multiple image file.

FIGS. 4A and 4B schematically describe types of image information.

FIG. 5 is a flow chart of the recording operation of a digital cameraaccording to a preferred embodiment of the present invention.

FIG. 6 shows the data structure of a single image file.

FIG. 7 shows the data structure of a multiple image file storing aplurality versions of display-image data.

FIG. 8 is a flow chart describing the continuous shooting mode of adigital camera according to a preferred embodiment of the presentinvention.

FIG. 9 shows an example of a menu for setting the pixel count of thedisplay-image data.

FIG. 10 shows the data structure of the multiple image file.

FIG. 11 shows an example of a menu for setting the aspect ratio of thedisplay-image data.

FIG. 12 shows the data structure of the multiple image file.

FIG. 13 describes a method of generating display-image data with adifferent aspect ratio than the main image.

FIG. 14 shows an example of a menu for setting the method of convertingthe aspect ratio of the display-image data.

FIG. 15 is a flow chart of the recording operation according to apreferred embodiment of the present invention when the digital camera isrotated when taking a picture.

FIG. 16 shows the display-image data displayed on the LCD monitor beforeimage rotation.

FIG. 17 shows the display-image data displayed on the LCD monitor afterimage rotation.

FIG. 18 shows an example of a menu for rotating the display-image data.

FIG. 19 is a flow chart of the reproduction process of a digital cameraaccording to a preferred embodiment of the present invention.

FIG. 20 is a flow chart of the display-image data generating processexecuted during reproduction of pictures.

FIG. 21 shows the structure of image files stored in the memory card.

FIG. 22 is a flow chart of the process for automatically selecting theimage data to be transmitted in a digital camera according to apreferred embodiment of the present invention.

FIG. 23 is a flow chart describing the display-image data transmissionoperation in a preferred embodiment of the invention.

FIG. 24 is a flow chart describing the transmission operation of adigital camera according to a preferred embodiment of the presentinvention.

FIG. 25 shows the data structure of a multiple image file.

FIG. 26 describes a method of generating display-image data with thesame aspect ratio as the main image when the aspect ratio is 4:3.

FIG. 27 describes a method of generating display-image data with thesame aspect ratio as the main image when the aspect ratio is 16:9.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Table of Contents 1 First Embodiment 1-1 Configuration 1-1-1Configuration of a digital camera 1-1-2 Configuration of the back of thedigital camera 1-1-3 Data structure of the image file format 1-1-3-1File structure 1-1-3-2 Main image part 1-1-3-3 Sub image part 1-1-3-4Image information 1-1-4 Relationship to the invention 1-2 Recordingoperation 1-2-1 Flow of Recording operation 1-2-2 Recording in acontinuous shooting mode 1-2-3 Various setting for Recording 1-2-3-1Setting for pixel count of the display- image data 1-2-3-2 Setting forthe aspect ratio of the display-image data 1-2-3-3 Generating method ofdisplay-image data with different aspect ratio 1-2-3-4 Recording withthe rotated camera 1-3 Reproduction operation 1-3-1 Flow of reproductionoperation 1-3-2 Accelerating the reproduction process 1-4 Transmissionof image data 1-4-1 Flow of image file transmission 1-4-2 PictBridgecompatibility 2 Second Embodiment 2-1 Flow of image file transmission 3Third Embodiment 3-1 Generated image file 3-2 Generating method of thedisplay-image data 3-2-1 When aspect ratio of the main image data is 4:33-2-2 When aspect ratio of the main image data is 16:9 3-3 Summary ofthe third embodiment 4 Other Embodiments

Preferred embodiments of the present invention are described below withreference to the accompanying figures. Note that parts that arefunctionally the same as parts that have already been described areidentified by the same reference numerals, and further descriptionthereof is omitted.

1 First Embodiment

A first embodiment of a digital camera according to the presentinvention is described next.

1-1 Configuration 1-1-1 Configuration of a Digital Camera

FIG. 1 is a block diagram showing the configuration of a digital camera101 according to a first embodiment of the invention. This digitalcamera 101 photographs subjects formed by an optical system 120 on a CCDimage sensor 141. The image data captured by the CCD image sensor 141 isthen processed by an image processor 160 and stored on a memory card 108or internal memory 109. The image data stored on the memory card 108,for example, can be displayed on an LCD monitor 110. The configurationof this digital camera 101 is described below.

The optical system 120 includes an objective lens 121, zoom lens 122,aperture 123, optical image stabilization (OIS) unit 124, and a focuslens 125. The optical system 120 focuses light from the subject andforms the subject image.

The objective lens 121 is the lens closest to the subject. The zoom lens122 enlarges or reduces the subject image by moving along the opticalaxis of the optical system 120. The aperture 123 adjusts the size of thelens opening as controlled automatically or manually by the user toadjust the amount of light passing through the optical system 120. TheOIS unit 124 has an internal correction lens that can move in the planeperpendicular to the optical axis. The OIS unit 124 reduces subject blurby driving the correction lens in the direction that cancels movement ofthe digital camera 101. The focus lens 125 adjusts the focus of thesubject by moving along the optical axis of the optical system 120.

A drive system 130 drives the optical elements of the optical system120.

A zoom motor 132 drives the zoom lens 122 along the optical axis of theoptical system 120. The zoom motor 132 may drive the zoom lens 122 usinga cam mechanism or a ball and screw mechanism, for example. The zoommotor 132 may be a pulse motor, a DC motor, a linear motor, a servomotor, or other type of motor.

The aperture actuator 133 is a drive unit for changing the size of theopening of the aperture 123. The aperture actuator 133 can be achievedusing a motor, for example.

The OIS actuator 134 drives the correction lens inside the OIS unit 124in the plane perpendicular to the optical axis. The OIS actuator 134 maybe a flat coil or ultrasonic motor, for example.

The focus motor 135 drives the focus lens 125 along the optical axis ofthe optical system 120. The focus motor 135 may drive the focus lens 125using a cam mechanism or a ball and screw mechanism, for example. Thefocus motor 135 may be a pulse motor, a DC motor, a linear motor, aservo motor, or other type of motor. Alternatively, the focus motor 135may be omitted and the zoom motor 132 used as the drive means fordriving both the zoom lens 122 and the focus lens 125.

The CCD image sensor 141 captures the subject image formed by theoptical system 120 to generate image data. The timing generator 142generates the timing signal for driving the CCD image sensor 141. TheCCD image sensor 141 controls various operations including exposure,data transfer, and the digital shutter according to the timing signalsupplied by the timing generator 142. An analog/digital (A/D) converter105 converts the image data generated by the CCD image sensor 141 to adigital signal.

The image processor 160 applies various processes to the image dataconverted by the A/D converter 105. The image processor 160 processesthe image data generated by the CCD image sensor 141 to generate imagedata to be stored in a memory card 108 and/or image data to be displayedon the LCD monitor 110. The image processor 160 also processes the imagedata stored in the memory card 108 to generate image data to bedisplayed on the LCD monitor 110, image data to be stored again to thememory card 108, and/or image data to be sent through a communicationunit 111 to an external device. The image processor 160 may beconfigured using a DSP or microprocessor, for example.

A preprocessor 161 applies various image processing operations, such asgamma correction, white balance correction, and scratch removal to theimage data converted by the A/D converter 105. The YC conversion unit162 converts RGB image data to image data represented by YC(Y=luminance, C=chrominance) signals.

The digital zoom processing unit 165 digitally enlarges or reduces theimage data. When digitally enlarging or reducing the image data, thedigital zoom processing unit 165 appropriately applies process includinginterpolation, subsampling, and cropping to the image data. Morespecifically, the digital zoom processing unit 165 is a means forconverting the pixel count of the image data.

The compression unit 163 compresses the YC image data using a DCT(discrete cosine transform), Huffman encoding, or other technique. Thecompression unit 163 preferably compresses the image data using acompression method compatible with the JPEG format, but the invention isnot limited to using JPEG image data.

The expansion unit 164 decodes the compressed image data to theuncompressed form when displaying compressed image data stored in thememory card 108 on the LCD monitor 110, for example.

The controller 150 is a control means for controlling overall operationof the digital camera 101. The controller 150 may be rendered using asemiconductor chip, for example. The controller 150 may be rendered as ahardware-only device or using a combination of both hardware andsoftware. The controller 150 may be rendered using a microprocessor.

Buffer memory 115 functions as working memory for the image processor160 and controller 150. The buffer memory 115 may be rendered using DRAMor ferroelectric memory, for example. A card slot 107 accommodates aremovable memory card 108. The card slot 107 enables mechanically andelectrically connecting the memory card 108.

The memory card 108 has internal flash memory or ferroelectric memoryfor storing data.

The internal memory 109 can be rendered using flash memory orferroelectric memory, for example. The controller 150 can store thegenerated image files to the memory card 108 or the internal memory 109.The controller 150 can also read image files stored in the memory card108 and write the files to internal memory 109, or read image filesstored in the internal memory 109 and write the files to the memory card108.

The LCD monitor 110 can display the images presented by the image datagenerated by the CCD image sensor 141, and images presented by the imagedata read from the memory card 108, for example. The LCD monitor 110 canalso display the settings of the digital camera 101. The LCD monitor 110can, for example, display the exposure value (EV).

The communication unit 111 is a means for communicating with an externaldevice. The communication unit 111 can be rendered using a wireless LANor a USB communication unit, for example. The operating unit 170collectively refers to various operating devices. The operating unit 170receives instructions from the user and communicates those instructionsto the controller 150. The flash 113 emits light to illuminate thesubject.

The rotation detector 190 detects rotation of the digital camera 101.The controller 150 can acquire information about the rotation of thedigital camera 101 detected by the rotation detector 190. The rotationdetector 190 may be rendered using a rotation sensor or angle sensor.The OIS actuator 134 may function as the rotation detector 190. This isbecause the OIS actuator 134 can detect how much the camera body hasbeen tilted from the drive current level.

1-1-2 Configuration of the Back of the Digital Camera

FIG. 2 shows the back of the digital camera 101 according to this firstembodiment of the invention. Various operating units are described belowwith reference to FIG. 2.

A shutter release button 171, zoom dial 172, and mode dial 174 aredisposed on top of the camera body. The shutter release button 171detects when it is depressed. When the shutter release button 171 isdepressed part way, the controller 150 starts automatic exposure (AE)control or automatic focus (AF) control. When the shutter release button171 is depressed all the way, the digital camera 101 takes a picture.

The zoom dial 172 is disposed so that it can be rotated around theshutter release button 171. As the zoom dial 172 is rotated, thecontroller 150 starts optical zoom control or digital zoom control.

The mode dial 174 is operated by rotating it. A dial is disposed to themode dial 174 and the operating modes of the digital camera 101 areassigned to specific positions on the dial. The operating modes of thedigital camera 101 include a reproduction (view) mode and a recordingmode. The controller 150 controls the digital camera 101 in theoperating mode indicated by the mode dial 174 according to therotational position of the mode dial 174.

A power switch 173, cursor key 180, delete button 186, and the LCDmonitor 110 are disposed on the back of the camera body. The powerswitch 173 is slidable. The power switch 173 switches the power state ofthe digital camera 101 according to the sliding position.

The LCD monitor 110 displays image data stored in the memory card 108and operating menus according to the operating mode selected by the modedial 174.

The cursor key 180 detects operation of five buttons, including fourdirectional buttons and a center button. The controller 150 controls thecontent displayed on the LCD monitor 110, including changing thedisplayed image data, based on how the cursor key 180 is operated.

The delete button 186 detects when it is depressed. The controller 150detects the preselected image data according to operation of the deletebutton 186.

1-1-3 Data Structure of the Image File Format 1-1-3-1 File Structure

FIG. 3 shows the data structure of a multiple image file that is handledby the digital camera 101 according to this embodiment of the invention.

This multiple image file contains image data for a plurality of images.In the example shown in FIG. 3 the multiple image file D10 stores mainimage data D23 and display-image data D33. The display-image data isimage data that is generated based on the main image data or the imagedata which is original of the main image data. The display-image data isgenerated by image processing, such as subsampling, interpolation, orother method, to the main image data or the image data which is originalof the main image data. The display-image data is stored in an areaother than the main header D22.

In FIG. 3, a single piece of display-image data is stored in the imagefile, however this embodiment of the invention may store plural piecesof display-image data in the image file. For example, plural pieces ofdisplay-image data with different aspect ratios may be stored as thedisplay-image data. This enables instantly displaying an image with theaspect ratio best suited to the aspect ratio of the image display deviceto which the digital camera 101 is connected.

Display-image data for plural images of different pixel counts can alsobe stored as the display-image data. This enables instantly displayingan image with the pixel count best suited to the pixel count of theimage display device to which the digital camera 101 is connected.

The FAT (File Allocation Table) stored in the memory card 108 managesthe multiple image file D10 as a single file by managing the headermarker D21 and footer marker D34. the controller 150 identifies andmanages the image files by reading the FAT.

The multiple image file D10 contains a main image part D20 and a subimage part D30. The structures of the main image part D20 and the subimage part D30 of the multiple image file D10 are separately describedbelow.

1-1-3-2 Main Image Part

The main image part D20 includes the Start Of Image marker D21, mainheader D22, main image data D23, and End Of Image marker D24.

The Start Of Image (SOI) marker D21 is a marker indicating the startingpoint of the multiple image file D10. The Start Of Image marker D21 is,for example, the start value (xFFD8) of a JPEG image file.

The main header D22 stores management data for the entire multiple imagefile D10. This management information includes, for example, thethumbnail image data D25 and image information D26.

The thumbnail image data D25 is reduced image data based on the mainimage data D23. The thumbnail image data D25 has an image size of, forexample, 160 horizontal dots and 120 vertical dots. The thumbnail imagedata D25 is stored in the main header D22 according to the Exifstandard.

The image information D26 is information relating to image data such asthe main image data D23 or display-image data D33, such as informationrelating to the pixel count, aspect ratio, and rotation of the image.This format enables acquiring information about the image data byreferencing only the main header D22, thereby enabling the controller150 to quickly process the multiple image file D10. For example, ifdisplay-image data with a pixel count conforming to the HDTV (HighDefinition Television) standard is stored in the display-image data D33,the main header D22 stores information denoting “HDTV” as the imageinformation D26. This enables the controller 150 to easily finddisplay-image data matching the pixel count of the display device thatwill display the image by simply interpreting the main header D22instead of interpreting the image data in the multiple image file D10.

The main image data D23 is the image data captured by the digital camera101 and compressed to the JPEG format.

The End Of Image (EOI) marker D24 is the marker (xFFD9) indicating theend of the main image part D20. By inserting this marker at the end ofthe main image part D20, it is not necessary to add new Start Of Image(SOI) and End Of Image (EOI) markers to new image files when themultiple image file D10 is divided into the new image files including animage file composed of the main image part D20 and an image filecomposed of the sub image part D30. As a result, the image files can beeasily separated.

1-1-3-3 Sub Image Part

The sub image part D30 includes a Start Of Image marker D31,display-image header D32, display-image data D33, and End Of Imagemarker D34.

The Start Of Image marker D31 is a marker indicating the beginning ofthe sub image part D30. A table for managing these markers is stored inthe main header D22. This enables easily finding the sub image data, andenables easily finding where to split the file when dividing the fileinto separate images. Providing this marker also makes it unnecessary toadd new SOI and EOI markers to new files when splitting the multipleimage file D10 into the new files. As a result, the image files can beeasily separated.

The display-image header D32 stores attribute information for thedisplay-image data D33. This attribute information includes, forexample, information identifying the display-image data D33 as the imagedata for display. The display-image data D33 is the image data generatedfor display on a display monitor such as a LCD, based on the main imagedata D23.

The End Of Image marker D34 is a marker indicating the end of the subimage part D30. A table for managing these markers is stored in the mainheader D22. This enables easily finding the sub image data, and enableseasily finding where to split the file when dividing the file intoseparate images. Providing this marker also makes it unnecessary to addnew SOI and EOI markers to new files when splitting the multiple imagefile D10 into the new files. As a result, the image files can be easilyseparated.

1-1-3-4 Image Information

Various types of information related to the image data is stored in themain header D22 and display-image header D32. Some of this imageinformation is shown in FIG. 4.

FIG. 4A shows an example of the image information D26 stored in the mainheader D22. As image information, image information for the main imageand image information for the display image are stored in the mainheader D22. When display-image data for a plurality of images is storedin the multiple image file D10, image information for each of thedisplay images is stored in the main header D22.

The image information for the main image includes, for example, pixelcount and rotation (orientation) information of image. In the example inFIG. 4A the pixel count is 1920 horizontal dots and 1440 vertical dots,and the image rotation is 90°.

Image information for the display image stored in the main header D22includes, for example, starting address information, display imageidentifier, image type information, aspect ratio information, androtation information. The starting address information indicates thestart address of the sub image part D30. The display image identifier isan identifier indicating that the image data stored in the sub imagepart D30 is image data for displaying. The image type informationidentifies the type of image data stored in the sub image part D30. Forexample, it includes VGA, HDTV, or other type of image. The aspect ratioinformation identifies the aspect ratio of the image stored in the subimage part D30. The rotation information identifies the angle ofrotation of the image data stored in the sub image part D30.

FIG. 4B shows an example of the image information stored in thedisplay-image header D32. The image information stored in thedisplay-image header D32 is image information related to thedisplay-image data D33. The type (item) of image information stored inthe display-image header D32 is the same as the type (item) of imageinformation for the main image stored in the main header D22. Morespecifically, the display-image header D32 stores the pixel count andimage rotation value.

The main header D22 thus stores image information for the main image(called “main image information” below) and image information for thedisplay image (called “first display-image information” below) as shownin FIG. 4A, and the display-image header D32 stores image informationfor the display image (called “second display-image information” below)as shown in FIG. 4B. The items (types) of image information contained inthe second display-image information stored in the display-image headerD32, and the items (types) of image information contained in the mainimage information stored in the main header D22, are thus “pixel count”and “rotation information”, and they are shared (see FIG. 4A and FIG.4B). When splitting the main image part D20 and sub image part D30 intotwo image files, the image information format described above enablescreating a new image file using the display-image data D33 as the mainimage data without greatly changing the information in the sub imagepart D30. This is because image information for the display-image dataD33 is already stored in the display-image header D32 using the sameformat as the main image information. Note that the items of the imageinformation stored in the main image information and the items of theimage information stored in the second display-image information do notall need to match, and it is sufficient if only some of the items are incommon.

The items of the image information contained in the first display-imageinformation stored in the main header D22 include “start address” and“display image identifier” as shown in FIG. 4A, and thus differ from theitems of the image information stored in the second display-imageinformation. The main header D22 includes detailed image informationnecessary for managing the display-image data D33, as the firstdisplay-image information. This enables the controller 150 to easilymanage the display-image data D33 by simply interpreting the imageinformation D26 in the main header D22.

1-1-4 Relationship to the Invention

The CCD image sensor 141, A/D converter 105, and image processor 160together render an example of the main image data acquisition means ofthe invention.

The setting means rendered by the pixel count setting menu screen M10 isan example of the setting means of the invention.

The configuration including the digital zoom processing unit 165 is anexample of the display-image data generating means of the invention.

The controller 150 is an example of the image file generating means ofthe invention.

The digital camera 101 is an example of the image file generating meansof the invention.

The communication unit 111 is an example of the communication means ofthe invention.

The communication unit 111 and controller 150 together render an exampleof the information acquisition means of the invention.

The aspect ratio conversion method selection menu M15 is an example ofthe generating method selection means of the invention.

The rotation detector 190 is an example of the rotation commandreceiving means of the invention.

The controller 150 is an example of an image file acquisition means ofthe invention.

The controller 150 is an example of an image file changing means of theinvention.

The multiple image file D10 is an example of an image file of a firsttype according to the invention.

The single image file D40 is an example of an image file of a secondtype according to the invention.

The card slot 107, controller 150, and LCD monitor 110 together renderan example of the reproduction means of the invention.

The controller 150 is an example of a sensing means of the invention.

The controller 150, image processor 160, and buffer memory 115 togetherrender an example of an image file conversion means according to theinvention.

The controller 150 and communication unit 111 together render an exampleof a transmission means according to the present invention.

The digital camera 101 is an example of an image file transmission meansaccording to the present invention.

The memory card 108, internal memory 109, and buffer memory 115 areexamples of storage means in the invention.

The controller 150 is an example of the extraction means of theinvention.

The digital camera 101 is an example of an image data transmissiondevice according to the present invention.

The communication unit 111 and controller 150 together render an exampleof a transmission command acquisition means according to the presentinvention.

1-2 Recording Operation

The image data recording operation of the digital camera 101 accordingto this first embodiment of the invention is described next. In thisembodiment of the invention the image file stores image data for an HDTVdisplay-image data for a WVGA display, and image data for a VGA displayas the display-image data.

1-2-1 Flow of Recording Operation

FIG. 5 is a flow chart of the recording operation of the digital camera101.

The mode dial 174 is operated by the user, and the digital camera 101 isset to the recording mode (S101). When the recording mode is set, thecontroller 150 waits until the shutter release button 171 is depressedcompletely (S102). When the shutter release button 171 is depressedcompletely, the CCD image sensor 141 captures an image and generates theimage data (S103). When the image data is generated, the image processor160 applies a particular image processing operation, such as imagecompression, to the generated image data to generate JPEG image data(main image data) (S104). When the JPEG image data is generated, thecontroller 150 stores the JPEG image data to the buffer memory 115(S105).

When the JPEG image data is stored in buffer memory 115, the controller150 determines if the digital camera 101 is set to the multiple filegeneration mode (S106). This multiple file generation mode is the modethat generates an image file storing both main image data anddisplay-image data (an image file such as the multiple image file D10shown in FIG. 3). The single file generating mode is the mode thatgenerates an image file storing only the main image data (an image filesuch as the single image file D40 shown in FIG. 6).

If the digital camera 101 is set to the single file generation modeinstead of the multiple file generation mode, the controller 150generates a single image file based on the JPEG image data stored in thebuffer memory 115 (S111). When a single image file is generated, thecontroller 150 stores the generated single image file to the memory card108 or internal memory 109 (S112).

If the digital camera 101 is set to the multiple file generation mode,the digital zoom processing unit 165 generates the display-image data byapplying image processing, such as subsampling and interpolation, to theJPEG image data stored in the buffer memory 115 (S107). Thedisplay-image data is, for example, image data with the pixel count ofan HDTV or VGA image. When the display-image data is generated, thecontroller 150 stores the display-image data in the buffer memory 115(S108).

When the display-image data is stored in the buffer memory 115, thecontroller 150 determines if all of the previously set display-imagedata has been generated (S109).

If all pieces of display-image data have not been generated, the digitalzoom processing unit 165 generates the display-image data that has notyet been generated (S107 to S108). For example, if two types ofdisplay-image data for HDTV and VGA images are to be created, the stepsdescribed above (S107-S108) repeat until the two types of display-imagedata are generated.

When it is determined that all pieces of display-image data have beengenerated, the controller 150 generates a multiple image file wrappingthe image data stored in the buffer memory 115 and stores the multipleimage file in a single file (S110). When the multiple image file isgenerated, the controller 150 stores the generated multiple image fileto the memory card 108 or internal memory 109 (S111).

By thus having two operating modes, a multiple file generation mode anda single file generation mode and enabling the user to select which modeto use, the user can easily select the image file of the desired imagefile format.

In this embodiment of the invention, when the recording operation stops,the multiple image file D70 shown in FIG. 7 is generated. As shown inFIG. 7, the multiple image file D70 stores the display-image dataordered by the pixel count. Note, in FIG. 7, that the Start Of Imagemarker (SOI) and End Of Image marker (EOI) are not shown and thedisplay-image header is also not shown.

By thus always ordering the display-image data by pixel count, findingthe desired display-image data is easier.

This embodiment of the invention generates the display-image data afterstoring the main image data in the buffer memory 115. Alternatively,however, the main image data and display-image data may be generatedsimultaneously, and the image file may be generated after the generationof the main image data and display-image data is finished. Thisconfiguration enables simultaneously generation of the main image dataand display-image data, and thus the image file can be quicklygenerated.

1-2-2 Recording in Continuous Shooting Mode

FIG. 8 is a flow chart of the recording operation when the digitalcamera 101 is set to a recording mode for continuous shooting (referredto below as the continuous shooting mode). The user can set the digitalcamera 101 to the continuous shooting mode (S601). When the continuousshooting mode is set, the controller 150 waits until the shutter releasebutton 171 is depressed completely (S602). When the shutter releasebutton 171 is pressed, the CCD image sensor 141 captures an image(S603). When an image is captured, the image processor 160 processes theimage and generates the JPEG image data (S604). When the JPEG image datais generated, the controller 150 stores the generated JPEG image data(main image data) in the buffer memory 115 (S605).

When the JPEG image data is stored in the buffer memory 115, thecontroller 150 determines if the continuous shooting mode that capturesthe predetermined number of pictures has ended (S606).

If the continuous shooting mode has not ended, the CCD image sensor 141repeats the image capture operation and these steps (S603˜S606) repeat.

If the continuous shooting mode has ended, the digital zoom processingunit 165 generates the display-image data based on the JPEG image datastored in the buffer memory 115 (S607). When the display-image data isgenerated, the controller 150 stores the generated display-image data tothe buffer memory 115 (S608).

When the display-image data is stored to the buffer memory 115, thecontroller 150 determines if display-image data has been generated forall JPEG image data in the buffer memory 115 (S609).

If all pieces of display-image data have not been generated, the digitalzoom processing unit 165 generates display-image data again and repeatssteps (S607˜S608).

When it is determined that all pieces of display-image data have beengenerated, the controller 150 creates an image file containing the mainimage data stored in the buffer memory 115 and the correspondingdisplay-image data (S610). When the image file is generated, thecontroller 150 stores the resulting image file to the memory card 108 orinternal memory 109 (S611).

When the image file is stored to the memory card 108 or internal memory109, the controller 150 determines if all image files have beengenerated (S612).

If all image files have not been generated, the controller 150 generatesthe image file again (S610-S611). However, if all image files have beengenerated, the controller 150 stops recording in the continuous shootingmode of the digital camera 101 (S613).

By thus first capturing all of the main image data and then generatingthe display-image data, the digital camera 101 can dedicate theprocessor power of the controller 150 to capturing the main image datawhen capturing the main image data in the continuous shooting mode. As aresult, processor power consumed by processes other than the capturingimages can be reduced when operating in the continuous shooting mode,and continuous shooting can be taken at high speed.

This embodiment of the invention generates the display-image data afterfirst capturing all of the main image data, but the main image data anddisplay-image data may be generated simultaneously, and the image filesmay be generated sequentially and stored to the memory card 108 orinternal memory 109. This greatly reduces the amount of image datatemporarily stored to the buffer memory 115. The storage capacity of thebuffer memory 115 can therefore be reduced greatly and the cost of thedigital camera 101 can be reduced.

Further alternatively, the main image data and the display-image datamay both be generated when the image is captured, temporarily stored inthe buffer memory 115. After continuous shooting is completed, the mainimage data and display-image data stored in the buffer memory 115 may becombined into a single image file, and the image file then may be storedto the memory card 108. With this method it also omits generating theimage file while capturing in the continuous shooting mode, and thus ahigh speed continuous shooting mode is also possible. Further thedisplay-image data can be generated while capturing the main image data,and thus the display-image data can also be generated relatively easily.

Further alternatively, the main image data may be generated during imagecapture and temporarily stored to the buffer memory 115. Aftercontinuous shooting is completed, the main image data stored in thebuffer memory 115 then may be read, the display-image data and imagefile may be generated, and the resulting image file may be stored to thememory card 108. This method also eliminates the process of creating theimage file while imaging in the continuous shooting mode, and thusenables high speed continuous shooting.

1-2-3 Various Settings for Recording

Various settings in the digital camera 101 for recording image data aredescribed next. The settings set in this example include the pixel countof the display-image data and the aspect ratio of the display-imagedata.

1-2-3-1 Setting for Pixel Count of the Display-Image Data

With reference to FIG. 9 and FIG. 10, setting for the pixel count of thedisplay image in the digital camera 101 according to this embodiment ofthe invention is described next. FIG. 9 shows an example of the displayscreen used for setting type of the display-image data. FIG. 10 is aschematic diagram of the image file generated when the image data iscaptured with the display image size set.

The user can preset the pixel count of the display-image data to bereproduced. The user sets the pixel count of the display-image data in amenu such as the pixel count setting menu screen M10 shown in FIG. 9. Inthis example, the user sets the pixel count by selecting one of pixelcounts such as VGA (640 horizontal pixels by 480 vertical pixels), andHDTV (1088 horizontal pixels by 612 vertical pixels). More specifically,the pixel count of the display-image data can be set using the LCDmonitor 110 and operating unit 170. In this case, the LCD monitor 110,controller 150, and operating unit 170 render the setting means of theinvention.

When the image is captured with pixel count of the display-image databeing set, the controller 150 generates an image file based on the mainimage data and the display-image data which has the predetermined pixelcount and is generated based on the captured main image data. Forexample, a multiple image file D50 such as shown in FIG. 10 isgenerated. The multiple image file D50 stores the display-image data inan area other than the header. The controller 150 then stores theresulting image file in the memory card 108 or internal memory 109.

The pixel count of the display-image data to be stored in the multipleimage file D50 can thus be set by user operation. As a result, thecontroller 150 can generate a multiple image file D50 storingdisplay-image data of the size desired by the user. For example, theuser can select the pixel count of the display-image data in order togenerate display-image data matching the pixel count of the displaydevice which the user uses most frequently.

In addition, the main header D51 shown in FIG. 10 stores the image sizeinformation D52. The image size information D52 is informationindicating the pixel count of the display-image data. More specifically,the main header D51 stores information relating to the display-imagedata. This enables the controller 150 to confirm the pixel count of thedisplay-image data by simply reading the main header D51.

The pixel count of the display-image data can be set automaticallyinstead of by the user as described above. This saves the time andeffort of setting the pixel count, and improves user convenience. Forexample, the pixel count may be automatically set according to theexternal device to which the digital camera 101 was last connected. Morespecifically, information about the pixel count may be acquired througha communications means from the last connected image display device, andthe display-image data may be generated using the pixel count indicatedby this information. In other words, the digital camera 101 may set thepixel count of the display-image data according to the pixel countinformation acquired from the image display device.

The type of output image data output from the digital camera 101 may beselected by the user, and the pixel count of the display-image data maybe set automatically based on this selection. For example, if the usersets HDTV as the type of output image data, the controller 150 sets HDTVas the pixel count of the display-image data to be stored in themultiple image file D50.

The main header D51 may also store image data of smaller size than thedisplay-image data described above. Image data of such a small size canbe image data which is generally called “thumbnail image”.

1-2-3-2 Setting for Aspect Ratio of the Display-Image Data

With reference to FIG. 11 and FIG. 12, setting an aspect ratio of thedisplay-image data in the digital camera 101 according to thisembodiment of the invention is described next. FIG. 11 shows the displayscreen used to select the aspect ratio of the display-image data. FIG.12 schematically shows an image file generated when the image data iscaptured after setting the aspect ratio.

The user can preset the aspect ratio of the image data to be recorded.The user sets the aspect ratio of the image data to be recorded using amenu such as shown in the aspect ratio setting menu screen M11 shown inFIG. 11. In this example, the user selects one aspect ratio from among agroup of aspect ratios such as 16:9 and 4:3.

When capturing the image proceeds with the aspect ratio being set, thecontroller 150 generates an image file from the captured main image dataand the display-image data which has the preset aspect ratio and isgenerated based on the main image data. This results in a multiple imagefile D60 as shown in FIG. 12, for example. The controller 150 thenstores the generated image file to the memory card 108 or internalmemory 109.

The aspect ratio of the display-image data to be stored in the multipleimage file D60 can thus be selected by the user. As a result, thecontroller 150 can generate a multiple image file D60 storingdisplay-image data with the aspect ratio desired by the user. The usermay, for example, select the aspect ratio of the display-image data togenerate display-image data matching the aspect ratio of the displaydevice which is used most frequently by the user.

The main header D61 shown in FIG. 12 also stores the image sizeinformation D62. The image size information D62 is informationindicating the aspect ratio of the display-image data. The main headerD61 thus stores information related to the display-image data.

With this arrangement, the controller 150 can confirm the aspect ratioof the display-image data by simply referencing the main header D61.

The aspect ratio of the main image data and the aspect ratio of thedisplay-image data may be set separately. This enables generatingdisplay-image data with a different aspect ratio than the aspect ratioof the main image data. For example, the case is considered, in whichthe image display device is a television. The aspect ratio of the CCDused in the digital camera is typically 4:3 while the aspect ratio ofthe television is 16:9. Thus, setting the aspect ratio of the main imagedata to 4:3 and the aspect ratio of the display-image data to 16:9allows image data best suited to each application to be achieved.

1-2-3-3 Generating Method of Display-Image Data with Different AspectRatio

With reference to FIG. 13 and FIG. 14, a method of generatingdisplay-image data (16:9) with a different aspect ratio than the aspectratio (4:3) of the main image data in a digital camera 101 according tothis embodiment of the invention is described next. FIG. 13 is aschematic diagram showing the image of the main image data (aspect ratioof 4:3) and an image of the display-image data (aspect ratio of 16:9).In FIG. 13 image data M12 is the main image data with an aspect ratio of4:3. Image data M13 with the top and bottom cropped and image data M14with added black bars on the right and left sides are image data havingthe aspect ratio of 16:9. FIG. 14 shows an example of a menu for settinga method to convert the main image data with an aspect ratio of 4:3 tothe display-image data with an aspect ratio of 16:9.

The digital camera 101 can select multiple different methods to convertthe main image data to display-image data with a different aspect ratiothan the main image data. Two methods of generating display-image datawith an aspect ratio of 16:9 from main image data with an aspect ratioof 4:3 are described below.

The first method includes cropping the top and bottom of the main imagedata with an aspect ratio of 4:3 to generate the display-image data withan aspect ratio of 16:9. By using this method, the controller 150 canproduce display-image data M13 with the top and bottom cut off from themain image data M12 with an aspect ratio of 4:3 (see FIG. 13). Morespecifically, the digital zoom processing unit 165 applies an imageprocess, such as cropping, subsampling, or interpolation, to the mainimage data or the image data that is the source of the main image dataso as to generate the display-image data M13 with the cropped top andbottom.

The second method includes reducing the image size of the main imagedata with an aspect ratio of 4:3 and inserting black bars in the areaswhere there is no data to generate the display-image data with an aspectratio of 16:9. This method can create the display-image data M14 withblack bars on the right and left sides from the main image data M12 (seeFIG. 13). More specifically, the digital zoom processing unit 165applies an image process such as cropping, subsampling, orinterpolation, to the main image data or the image data that is thesource of the main image data so as to generate the display-image dataM14 with the black bars on the right and left sides.

In this embodiment of the invention the user can select either one ofthe two methods of generating the display-image data. The digital camera101 thus has a plurality of display-image data generating methods, andhas a generating method selection means for setting which of the pluralmethods is used to generate the display-image data. For example, in anaspect ratio conversion method selection menu M15 such as shown in FIG.14, the user can set the method for converting the aspect ratio whengenerating the display-image data from the main image data. By thusenabling the user to select the aspect ratio conversion method, the usercan get display-image data as desired.

In addition, by combining a valid image area and a no-image-signal areato generate the display-image data, the display-image data with anaspect ratio different from the aspect ratio of the main image data canbe generated. The display-image data with black bars as described aboveis one example of this method. A display image with a different aspectratio than the main image can also be generated by inserting black barsat the top and bottom or by inserting blue bars on the right and leftsides. When the display-image data is generated by thus combining avalid image area and a no-image-signal area, specific information foridentifying the valid image area is preferably stored in the main headerand/or the display-image header. This provides compatibility withprocesses, such as printing, that use only the data in the valid imagearea.

1-2-3-4 Recording with the Rotated Camera

With reference to FIG. 15, recording operation when the digital camera101 which is rotated in this embodiment of the invention is describednext. FIG. 15 is a flow chart of the recording operation when thedigital camera 101 is rotated.

The user can take a picture of a subject with the digital camera 101rotated (S200). In this case, the rotation detector 190 detects theangle of rotation of digital camera 101, and the controller 150 canacquire the rotation information from the rotation detector 190 anddetermine based on the rotation information if the digital camera isrotated.

After an image of the subject is captured, the image processor 160processes the image data to generate JPEG image data (S201). When theJPEG image data is generated, the controller 150 stores the resultingJPEG image data to the buffer memory 115 (S202).

The controller 150 then determines if the digital camera 101 is set tothe multiple image file generation mode (S203).

If it is determined that the single image file generation mode is set,the controller 150 stores the rotation information acquired from therotation detector 190 in the header, and reads the image data stored inthe buffer memory 115 to generates an image file (single image file)(S204). The controller 150 then stores the generated image file in thememory card 108 or internal memory 109 (S205). The display-image data isnot generated at this time.

On the other hand, if it is determined that the multiple image filegeneration mode is set, the digital zoom processing unit 165 generatesthe display-image data based on the main image data stored in the buffermemory 115 (S206). The display-image data generated at this time isrotated. More specifically, the digital zoom processing unit 165 appliesan image reduction process and a rotation process to the main image datato generate the display-image data. This rotation process is a pixelposition conversion process that converts horizontal pixel rows in thedisplay-image data to vertical pixel rows. The digital zoom processingunit 165 may also change the pixel count of the display-image data afterit is rotated according to the angle of rotation indicated by therotation information. More specifically, when the rotation processconverts landscape mode display-image data to portrait-orienteddisplay-image data, the digital zoom processing unit 165 may change thepixel count of the display-image data after rotation so that thevertical pixel count of the display-image data after rotation is equalto the horizontal pixel count of the display-image data before rotation.

After the display-image data is generated, the controller 150 stores thegenerated display-image data in the buffer memory 115 (S207). At thistime, rotation information indicating that the generated display-imagedata is captured with the rotated digital camera 101 is also stored inthe buffer memory 115 (S207). The controller 150 then generates an imagefile (multiple image file) from the main image data stored in buffermemory 115, the display-image data after rotation processing, the mainimage data rotation information, and the display-image data rotationinformation (S208). The controller 150 then stores the generated imagefile in the memory card 108 or internal memory 109 (S209).

For example, in a case that a picture is taken with the digital camera101 rotated 90 degrees to the right, the image is displayed on the LCDmonitor 110 as shown in FIG. 16 when the captured image is reproduced asusual. However, when the display-image data stored in the image filegenerated according to the procedure shown in the flow chart of FIG. 15is reproduced, the image data is displayed on the LCD monitor 110 afterthe rotation process as shown in FIG. 17.

If the image file does not contain display-image data, the controller150 can display the image data after rotation by referring to therotation information in the main header during reproduction of the mainimage data. More specifically, the rotated image data can be reproducedby referencing the rotation information (information relating to thedirection of rotation and the angle of rotation) that is stored in themain header of the image file, during reproduction of the image.

As described above, the digital camera 101 according to this embodimentof the invention has a configuration including a CCD image sensor 141for capturing main image data, an A/D converter 105, and an imageprocessor 160. The digital camera 101 also has a rotation detector 190,digital zoom processing unit 165, and controller 150. The rotationdetector 190 detects rotation of the digital camera 101. The digitalzoom processing unit 165 generates rotated image data by applying apredetermined process including a rotation conversion to the main imagedata or the image data as the source image of the main image dataaccording to the detection result (rotation information) from therotation detector 190. The controller 150 then generates an image filecontaining the resulting display-image data. The generated image fileincludes a header storing the rotation information, the un-rotated mainimage data, and the display-image data after rotation, and stores thedisplay-image data in the other area than the header. Because thedisplay-image data is thus stored in the image file after being rotated,it is not necessary to apply the rotation process to the display-imagedata when reproducing the display-image data, and the display-image datacan be quickly reproduced.

The digital zoom processing unit 165 may also change the pixel count ofthe display-image data after rotation according to the angle ofrotation. This enables sizing the display-image data to the display whenthe display-image data is generated. More specifically, the pixel countof the display-image data after rotation is preferably changed so thatthe vertical pixel count of the portrait-oriented display-image data isequal to the vertical pixel count of the landscape-orienteddisplay-image data. This allows a portrait-oriented image to size to fitin the display screen, and thus it is not necessary to change the pixelcount when reproduction of the portrait-oriented display-image data.

In addition, in this embodiment of the invention, when data for pluraldisplay images is stored for the main image data and if the image istaken with the digital camera 101 rotated, all display-image data isrotated and stored. For example, the case is considered, in which thedisplay-image data for displaying on a TV and the display-image data fordisplaying on the LCD monitor of a digital camera are stored as thedisplay-image data for the main image data. Both the display-image datafor displaying on a TV and the display-image data for displaying on theLCD monitor of a digital camera are rotated when the image is capturedwith the digital camera 101 rotated.

In this manner, when the main image data is rotated, all pieces ofdisplay-image data generated therefrom are thus also rotated. Thisprevents the orientation of one version of the display-image data fromdiffering from the orientation of other versions of the display-imagedata. As a result, the user can rotate the image data withoutconsidering the type of image data (that is, main image data,display-image data for a TV, display-image data for the monitor of adigital camera, or the like).

This embodiment of the invention also enables generating bothdisplay-image data that is not rotated and display-image data that isrotated, when a picture is taken with the digital camera 101 rotated. Animage file can be generated from the main image data, display-image datathat is not rotated, and display-image data that is rotated. Thisenables rapidly viewing the display-image data which is not rotated andthe display-image data which is rotated.

This embodiment of the invention generates the rotated display-imagedata when the picture is taken, but the rotated display-image data maybe generated when the image is reproduced. In this case, while thedisplay-image data is read from the image file stored in the memory card108 or internal memory 109 and displayed on the LCD monitor 110, thecontroller 150 reads the main image data from the image file stored inthe memory card 108 or internal memory 109 and generates the rotateddisplay-image data when receiving a command for recording with rotationfrom the operating unit 170. For example, a setting menu (rotationrecord setting menu) M16 enabling the user to generate the rotateddisplay-image data may be provided as shown in FIG. 18. This menu isdisplayed by operating the mode dial 174. When the user selects therotation record setting menu M16, the operating unit 170 sends a controlsignal (rotation command) to the image processor 160. The digital zoomprocessing unit 165 receives this control signal (rotation command),generates the rotated display-image data according to the methoddescribed above, and stores the resulting display-image data in theimage file in place of or in addition to the existing unrotateddisplay-image data.

The controller 150 can thus acquire an image file that has a header,main image data, and display-image data, and stores the display-imagedata in an area other than the header. When receiving a rotate command,the image processor 160 may generate display-image data that is rotatedaccording to the rotate command. The controller 150 then may storerotation information denoted by the rotate command in the header, andmay store the rotated display-image data in the image file instead of orin addition to the unrotated display-image data.

The reproduction process of the rotated display-image data can thus besimplified even after the image file is generated, by thus rotating thedisplay-image data and storing the rotated display-image data in theimage file.

Degradation of the rotated display-image data can also be prevented bygenerating the rotated display-image data based on the main image dataor the source image data of the main image data.

Note that the rotated display-image data may alternatively be generatedbased on the display-image data before rotation. In this case, therotated display-image data can be easily generated by converting thehorizontal and vertical pixel arrays. However, repeating the rotationprocess may also result in degraded display-image data after rotation.It is therefore preferable to generate the rotated display-image databased on the main image data because this can prevent degradation of thedisplay-image data after rotation.

1-3 Reproduction Operation

The reproduction operation of image data by the digital camera 101according to this embodiment of the invention is described next.

1-3-1 Flow of Reproduction Operation

FIG. 19 is a flow chart of the reproduction operation of the digitalcamera 101. User's operation with the mode dial 174 sets the digitalcamera 101 to the reproduction mode (S700). When the reproduction modeis set, the LCD monitor 110 displays the image data which was reproducedlast. When the image data is displayed, the controller 150 waits forinput from the cursor key 180 (S701).

When input from the cursor key 180 is detected, the controller 150determines whether the input key is the left key 184 or the right key182 (S702).

If the input key is the left key 184, the controller 150 determines ifdisplay-image data matching the pixel count of the LCD monitor 110displaying the image data is stored in the image file located before theimage file storing the currently displayed image data (S703).

If such display-image data is not found, the digital zoom processingunit 165 generates display-image data based on the main image data(S704). The LCD monitor 110 then displays the generated display-imagedata (S705). If such display-image data is found, the LCD monitor 110displays the display-image data (S706).

If the input key is the right key 182, the controller 150 determines ifdisplay-image data matching the pixel count of the LCD monitor 110displaying the image data is stored in the image file located after theimage file storing the currently displayed image data (S707).

If such display-image data is not found, the digital zoom processingunit 165 generates display-image data based on the main image data(S708). The LCD monitor 110 then displays the generated display-imagedata (S709). If such display-image data is found, the LCD monitor 110displays the display-image data (S710).

Reproduction of the display-image data on the LCD monitor 110 of thedigital camera 101 is described above, but the display-image data mayalso be displayed on an image display device externally connected to thedigital camera 101, such as a television. In this case the controller150 determines if there is display-image data matching the pixel countof the image display device in step S703 and S707.

1-3-2 Accelerating the Reproduction Process

With reference to FIG. 20 and FIG. 21, other processes executed duringimage data reproduction are described next. FIG. 20 is a flow chart ofanother process executed during image data reproduction. FIG. 21schematically describes the structure of image files stored in thememory card 108 or internal memory 109. FIG. 21 shows that image filesare stored in the order of multiple image file F10, multiple image fileF20, single image file F30. More specifically, the images are stored inthe memory card 108 so that if forward reproduction is instructed by theuser with the cursor key, the images are displayed in the sequencemultiple image file F10-->multiple image file F20-->single image fileF30, and if backward reproduction is instructed, the images aredisplayed in reverse order, that is, the images are displayed in thesequence single image file F30-->multiple image file F20-->multipleimage file F10.

An operation with the digital camera 101 connected to an image displaydevice is described next, when image data stored in the memory card 108or internal memory 109 is displayed on the image display device. Theimage display device in this example is a high definition television(HDTV).

User's operation with the mode dial 174 sets the digital camera 101 tothe reproduction mode (S800). When the reproduction mode is set, the LCDmonitor 110 displays the image data which was reproduced last (S801).For example, if the last reproduced image data is related to themultiple image file F20 shown in FIG. 21, the VGA display-image data (orWVGA display-image data) stored in the multiple image file F20 isdisplayed on the LCD monitor 110, and the HDTV display-image data storedin the multiple image file F20 is simultaneously displayed on the imagedisplay device. When the image data is displayed, the controller 150acquires the pixel count of the image display device from the imagedisplay device connected to the digital camera 101 (S802).

When the pixel count is acquired, the controller 150 determines if thereis display-image data matching the specifications of the image displaydevice in the image files (multiple image file F10 and single image fileF30 in FIG. 21) stored in the memory card 108 or internal memory 109within a predetermined number (“1” in the example shown in FIG. 21) offiles before and after the multiple image file F20 (S803, S804). Morespecifically, the controller 150 determines if display-image data with apixel count matching the pixel count of the image display device isfound in the predetermined number of image files before and after theimage being displayed.

If display-image data matching the pixel count of the image displaydevice is found within the predetermined number of image files, thecontroller 150 does not create a new display image but waits for changeby the user of the image data being reproduced on the display (S807).When the image data being reproduced is changed, the controller 150repeats the process described above (S802 to S804).

If display-image data matching the pixel count of the image displaydevice is not found within the predetermined number of image files, thecontroller 150 generates display-image data with the pixel count of theimage display device for those image files (S805). For example, FIG. 21shows that the multiple image file F10 includes HDTV display-image databut the single image file F30 does not HDTV display-image data. In thiscase, the controller 150 does not generate HDTV display-image data forthe multiple image file F10, but generates HDTV display-image data forthe single image file F30.

When the display-image data is generated, the controller 150 adds thegenerated display-image data to the image file (S806). For example, inFIG. 21 the generated HDTV display-image data is added to the singleimage file F30.

During reproduction of one image, this embodiment of the invention thusdetects if display-image data matching the pixel count of the imagedisplay device is found in a predetermined number of image files beforeand after the image file storing the image data being displayed. Ifdisplay-image data with the matching pixel count is not found, itgenerates and stores display-image data with the matching pixel count inthat image file. Thus, display-image data matching the specifications(pixel count) of the image display device can be prepared for all imagefiles within the predetermined number before and after the image filebeing displayed. Accordingly, the user can browse forward/backwardrapidly through the stored images on the image display device. Inaddition, only display-image data matching the specifications of theimage display device is created when generating the display-image data,and therefore the processor load and time required to generate thedisplay-image data can be reduced.

The controller 150 adds the generated display-image data to the imagefile in this embodiment of the invention, but the generateddisplay-image data may be stored to the buffer memory 115 instead. Thisconfiguration enables the user to rapidly display the image data withoutchanging the image data stored in the image file.

This embodiment of the invention searches the image files within apredetermined number of files before and after the image file beingdisplayed, but the invention is not so limited. For example, apredetermined number of image files may be searched only in the forwarddirection or only in the reverse direction.

This embodiment of the invention detects the presence of display-imagedata with the pixel count matching the pixel count of the image displaydevice, and determines whether to create the display-image data.Alternatively, whether the type of image file within a predeterminednumber of files before and after the image file being displayed is amultiple image file or single image file may be determined. If the filetype is a single image file, display-image data with a predeterminedpixel count (for example, the pixel count of the image display device)may then be generated. In this case the display-image data may begenerated and prepared in advance without getting the pixel countinformation from the image display device.

1-4 Transmission of Image Data

The digital camera 101 according to this embodiment of the invention cantransmit already recorded image files and image data stored in the imagefiles to an external device. This image file transmission operation isdescribed next with reference to FIG. 22 and FIG. 23. The digital camera101 according to this embodiment of the invention conforms to thePictBridge standard (detailed later).

1-4-1 Flow of Image File Transmission

With reference to FIG. 22, the operation for automatically selecting theimage data to be transmitted in this embodiment of the invention isdescribed next. FIG. 22 is a flow chart of the image file transmissionprocess in this embodiment of the invention. When the user attempts tosend a multiple image file to a device that is not compatible with themultiple image file format, the image data to be sent is automaticallyselected from the multiple image file.

In this embodiment of the invention, user's operation of the cursor key180 selects an image file to be sent, during reproduction of the imagedata on the screen (S500). When the image file to be sent is selected,the controller 150 inquires at the destination device about a pixelcount (S501).

The controller 150 determines the pixel count of the destination devicebased on the response from the destination device (S502). That is, thecontroller 150 determines the image data to be send based on aninstruction from the destination device. If the pixel count of thedestination device is equal to that of an HDTV device, the controller150 determines if HDTV display-image data is in the image file selectedby the user (S503).

If HDTV display-image data is found, the communication unit 111 sendsthe HDTV display-image data to the destination device (S504).

If HDTV display-image data is not found, the controller 150 generatesHDTV display-image data based on the main image data in the image fileselected by the user (S505). The communication unit 111 then sends theresulting display-image data to the destination device (S506).

If the pixel count of the destination device is equal to that of VGA,the controller 150 determines if VGA display-image data is stored in theimage file selected by the user (S507).

If VGA display-image data is found, the communication unit 111 sends theVGA display-image data to the destination device (S508).

If VGA display-image data is not found, the controller 150 generates VGAdisplay-image data based on the main image data in the image fileselected by the user (S509). The communication unit 111 then sends theresulting display-image data to the destination device (S510).

The communication unit 111 can thus transmit display-image data with thepixel count suitable to the destination device by means of aconfiguration that sends display-image data according to the pixel countof the destination device.

In addition, the user can conduct a transmission operation withoutknowing the pixel count of the destination device, by means of aconfiguration that automatically selects image data conforming to thespecification of the destination device.

If display-image data which is determined to be transmitted is notfound, display-image data suitable for transmission may be automaticallyselected from the existing display-image data and sent. Thisconfiguration eliminates the need to generate display-image data andthus shortens the transmission time, when an image file that does notcontain the conforming display-image data is transmitted.

One method of automatically selecting the display-image data may selectthe display-image data with the highest pixel count among thedisplay-image data stored in the image file, which may then betransmitted. This simplifies selecting the image to be transmitted andenables displaying an image with the highest possible quality.

This embodiment of the invention describes a configuration compatiblewith two pixel counts, HDTV and VGA. However the invention may also becompatible with other pixel counts, such as WVGA, CIF, and QCIF. Thisenables automatically selecting and transmitting image data that bestmatches the pixel count of each of destination devices having differentpixel counts.

This embodiment of the invention describes transmitting display-imagedata matching the pixel count of the destination device. Howeverdisplay-image data with an aspect ratio matching the aspect ratio of thedestination device may be transmitted. This configuration enables thecommunication unit 111 to transmit image data with an aspect ratiosuitable for the destination device. In addition, because the image datato be sent is automatically selected, the user can conduct atransmission operation without knowing the aspect ratio of thedestination device.

This embodiment of the invention describes transmitting display-imagedata matching the pixel count of the destination device. However thedisplay-image data to be sent may be selected based on the type ofdestination device. The type of destination device refers toclassification by product, for example, a high definition television, ananalog television, a digital camera, a personal computer, or the like.

By thus sending image data according to the type of destination device,the image data can be effectively classified when the number ofdestination device types is few. For example, if the destination deviceis a HDTV, image data with an aspect ratio of 16:9 can be transmitted,while if the destination device is an analog television, image data withan aspect ratio of 4:3 can be transmitted. Display-image data with apixel count suitable to the destination external device can also betransmitted.

This embodiment of the invention selects the image data to betransmitted from the display-image data in the image file, but the imagedata may be selected from the main image data and the display-imagedata.

This enables transmitting of image data better suited to the deviceincluding devices used for image editing such as personal computers anddigital cameras, instead of only to devices used primarily fordisplaying image such as televisions. This also prevents such problemsas being unable to transmit image data to the external device.

1-4-2 PictBridge Compatibility

FIG. 23 is a flow chart of the process executed when the digital camera101 according to this embodiment of the invention receives atransmission request for thumbnail image data from aPictBridge-compatible printer.

PictBridge is a standard enabling directly connecting a digital camerato a printer for easily printing digital pictures. When aPictBridge-compatible digital camera and printer are connected, imagedata stored in the digital camera can be printed directly from theprinter. With the PictBridge standard, a transmission request for theimage data to be printed is sent from the printer to the digital camera,and the digital camera then sends the image data to the printer in replyto the transmission request. The image data is thus printed. When athumbnail image is printed according to the PictBridge standard,transmission of the thumbnail image data is requested.

Referring to FIG. 23, while the digital camera 101 and printer areconnected, user's operation with the cursor key 180 of the digitalcamera 101 selects the image data to be printed (S400). When the imagedata is selected, the printer sends a transmission request for the imagedata and the corresponding thumbnail image data, to the digital camera101 (S401). When the thumbnail image data is requested, the controller150 of the digital camera 101 searches for the display-image data havingthe highest pixel count among display-image data related to the imagedata specified by the printer (S402). When the display-image data withthe highest pixel count is found, the communication unit 111 sends thisdisplay-image data to the printer (S403). More specifically, when atransmission request for sending thumbnail image data is received fromthe printer, the digital camera 101 extracts the display-image data withthe highest pixel count from the plural pieces of display-image datastored in the image file (S402), and sends it (S403).

Sharp image data with a high pixel count can thus be printed by sendingdisplay-image data with the highest pixel count in response to adisplay-image data transmission request from the printer. In addition,by deciding to always send image data with the highest pixel count, itis not necessary to determine what display-image data should be sentwhen transmitting the display-image data. The transmission operation istherefore simplified for the digital camera 101. In addition,transmitting display-image data shortens the transmission time comparedwith transmitting the main image data.

2. Second Embodiment

A second embodiment of a digital camera according to the presentinvention is described next. Aspects of the configuration and operationof this embodiment that are not described below are the same as in thefirst embodiment described above. The operation for automaticallyselecting image to be sent suitable for the specifications of theexternal device when image data is transmitted to an external deviceconnected to the digital camera is described next.

2-1 Flow of Image File Transmission

With reference to FIG. 24, the operation in this embodiment of theinvention for automatically selecting the image data to be transmittedis described next. FIG. 24 is a flow chart of the process forautomatically selecting the image data to be transmitted in thisembodiment of the invention. In this embodiment of the invention, whenthe user attempts to send a multiple image file to an external devicethat is not compatible with the multiple image file format, image datato be transmitted suitable for the external device is automaticallyselected.

User's operation during reproduction of the image with the cursor key180 of the digital camera 101 selects an image file for transmission(S300).

When an image file is selected, the controller 150 determines if theexternal device to which the image file is to be sent is compatible withthe multiple image file format (S301). “Compatible with the multipleimage file” means that the external device to which the file will besent can recognize the received multiple image file as a multiple imagefile. Whether the external device is compatible with the multiple imagefile format is determined by acquiring from the external device aninstruction indicating whether the external device can handle thedisplay-image data.

If the external device is determined to be compatible with a multipleimage file, the controller 150 sends the selected image file to theexternal device through the communication unit 111 (S302).

If the external device is determined to be not compatible with amultiple image file, the controller 150 determines if the selected imagefile is a multiple image file (S303).

If the selected image file is not a multiple image file (that is, it isa single image file), the controller 150 sends the selected image fileto the external device (S304).

If the selected image file is determined to be a multiple image file,the controller 150 deletes all pieces of display-image data from theimage file, and sends the image file storing only the main image data tothe external device (S305).

The digital camera 101 according to this embodiment of the inventionthus has a communication means that sends an image file from which thedisplay-image data has been deleted through the communication meansaccording to a command from an external device. As a result, if thedestination external device is not compatible with the multiple imagefile format, the image file is converted to a single image file fortransmission. As a result, even an external device that is notcompatible with a multiple image file can handle the image file. Theinstruction from the external device therefore preferably indicateswhether the external device can handle the display-image data.

3 Third Embodiment

A digital camera according to a third embodiment of the invention isdescribed next. The configuration and operation of this embodiment thatare not described below are the same as in the first embodimentdescribed above.

In this embodiment of the invention the image file stores display-imagedata with the same aspect ratio as the main image data regardless of thevalue of the aspect ratio.

3-1 Generated Image File

FIG. 25 shows the structure of the image file generated by the digitalcamera according to this embodiment of the invention. The Start Of Imagemarker and End Of Image marker are omitted in FIG. 25. The image fileD80 stores main image data D81, VGA display-image data D82, and HDTVdisplay-image data D83. The main image data D81 is generated byprocessing the image data captured by the CCD image sensor 141. The VGAdisplay-image data D82 and HDTV display-image data D83 are generatedbased on the main image data D81. In this embodiment of the invention,VGA display-image data D82 and HDTV display-image data D83 are used byway of example as the display-image data, and these can be preset or setselectively. If set selectively, they can be selected by the user orautomatically selection based on the imaging environment, for example.

The main image data D81, VGA display-image data D82, and HDTVdisplay-image data D83 have the same aspect ratio. For example, if theaspect ratio of the main image data D81 is 4:3, the aspect ratio of boththe VGA display-image data D82 and the HDTV display-image data D83 isalso 4:3. If the aspect ratio of the main image data D81 is 16:9, theaspect ratio of both the VGA display-image data D82 and HDTVdisplay-image data D83 is 16:9.

By thus rendering all display-image data with the same aspect ratio asthe main image data, the aspect ratio of the display-image data isautomatically determined when the aspect ratio of the main image data isset, so that processing is simplified.

3-2 Generating Method of the Display-Image Data

How the digital camera according to this embodiment of the inventiongenerates the display-image data based on the main image data isdescribed next.

3-2-1 When Aspect Ratio of the Main Image Data is 4:3

FIG. 26 is an explanatory view of a method for generating HDTVdisplay-image data (pixel count: 1920 horizontal×1080 vertical) or VGAdisplay-image data (pixel count: 640 horizontal×480 vertical) based onmain image data with an aspect ratio of 4:3. The pixel count of the mainimage data is, for example, 4000 horizontal×3000 vertical.

The size of an HDTV image is 1920 horizontal pixels×1080 verticalpixels. The digital zoom processing unit 165 applies an imageprocessing, such as cropping, subsampling, or interpolation, to the mainimage data D81 to make the HDTV display-image data D82 so that the HDTVdisplay image fits in the HDTV pixel area (image size). Moreparticularly, the digital zoom processing unit 165 generates the HDTVdisplay-image data D82 so that the pixel count (image size) is themaximum pixel count that fits in the HDTV pixel area while keeping theaspect ratio the same as that of the main image (4:3). In thisembodiment of the invention, therefore, the pixel count of the HDTVdisplay-image data D82 is 1440 horizontal×1080 vertical. Morespecifically, the vertical pixel count of the HDTV display-image dataD82 is the same as the vertical pixel count of the HDTV pixel area.

“The pixel count that fits in the pixel area” as used here means thatboth the horizontal pixel count and the vertical pixel count of thedisplay-image data is less than or equal to a predetermined pixel count(for example, 1920 horizontal and 1080 vertical in the case of an HDTVimage).

The VGA pixel area is 640 horizontal×480 vertical. The digital zoomprocessing unit 165 generates the VGA display-image data D83 to fit inthe VGA image size by applying image processing, such as cropping,subsampling, or interpolation, to the main image data D81. The digitalzoom processing unit 165 generates the VGA display-image data D83 sothat the pixel count (image size) is the maximum pixel count that fitsin the VGA pixel area while keeping the aspect ratio the same as that ofthe main image (4:3). In this embodiment of the invention, therefore,the pixel count of the VGA display-image data D83 is 640 horizontal×480vertical. More specifically, the vertical pixel count and horizontalpixel count of the VGA display-image data D83 are equal to the verticalpixel count and horizontal pixel count of the VGA pixel area.

3-2-2 When Aspect Ratio of the Main Image Data is 16:9

FIG. 27 is an explanatory view of a method for generating HDTVdisplay-image data or VGA display-image data based on main image datawith an aspect ratio of 16:9 in this embodiment of the invention.

Even when the aspect ratio of the main image data is 16:9, thedisplay-image data is generated in the same way as that when the aspectratio of the main image data is 4:3. The pixel count of the VGAdisplay-image data D82 is therefore 1920 horizontal×1080 vertical inthis embodiment of the invention. More specifically, the vertical pixelcount and horizontal pixel count of the VGA display-image data D82 arethe same as vertical pixel count and horizontal pixel count of the HDTVpixel area.

The pixel count of the VGA display-image data D83 is 640 horizontal×360vertical. More specifically, the horizontal pixel count of the VGAdisplay-image data D83 is the same as the horizontal pixel count of theVGA pixel area.

3-3 Summary of the Third Embodiment

As described above, a digital camera according to these embodiments ofthe invention has main image data acquisition means, display-image datagenerating means, and image file generating means. The main image dataacquisition means acquires the main image data. The main image dataacquisition means may be rendered by means of, for example, a CCD imagesensor 141, an A/D converter 105 and an image processor 160. Thedisplay-image data generating means generates display-image data basedon the main image data or the image data that is the source of the mainimage data under preset or selectively set conditions so that thedisplay-image data can be generated to fit in a pixel area with apredetermined aspect ratio and predetermined vertical and horizontalpixel counts.

The display-image data generating means can be rendered by means of thedigital zoom processing unit 165, for example. The image file generatingmeans generates an image file including a header, main image data, anddisplay-image data, and stores the display-image data in an area otherthan the header. The image file generating means can be rendered by thecontroller 150, for example.

Even if the aspect ratio of the main image data differs from thepredetermined aspect ratio (the aspect ratio that is preset orselectively set in the digital camera), the display-image datagenerating means in this embodiment of the invention generates thedisplay-image data so that the generated display image has the sameaspect ratio as the main image data and fits in the pixel area describedabove. Therefore, even if the aspect ratio of the main image datadiffers from the set aspect ratio, the display-image data can begenerated without changing the composition of the main image and withoutadding extra data.

For example, if it is configured that the image is added with blackbands when the aspect ratio of the main image data differs from the setaspect ratio, the black bars may possibly be inserted where they are notneeded. Likewise, if it is configured that the display-image data isgenerated by cropping the top and bottom of the main image data, aportion of the actual pixel area may possibly be deleted and thecomposition of the display-image data would differ from the compositionof the main image data. To the contrary, the method of the inventiondescribed above, generates the display-image data without changing thecomposition of the main image and without adding extra data, therebypreventing unnecessarily increasing the size of the display-image data.Yet further, when sending data to an external device (printer, forexample) that requires only the essential part, the external device doesnot need to remove unnecessary parts from the display-image data.

The display-image data generating means in this embodiment of theinvention generates the display-image data with the highest pixel countthat fits in the pixel area. The display-image data generating means inthis embodiment of the invention also generates the display-image dataso that either the vertical or horizontal pixel count of thedisplay-image data equals either the vertical or horizontal pixel countof the pixel area. As a result, display-image data with the highestresolution can be generated without changing the composition of the mainimage and without adding extra data.

4 Other Embodiments

The invention is described above with reference to preferred first tothird embodiments of the invention, but the invention is not so limited.Variations such as described below are also conceivable, for example.

The optical system and drive system of a digital camera according to thepresent invention are not limited to those shown in FIG. 1. FIG. 1 showsan optical system with four lens groups, for example, but a differentlens configuration may be used instead. The optical system is alsorendered with a zoom lens 122 in FIG. 1, but a single-focus opticalsystem without a zoom lens may be used instead. The OIS unit 124 is alsonot essential. The lenses may also be rendered using one or a pluralityof lens elements. The zoom motor 132 and focus motor 135 may also berendered using a single common motor.

The imaging element in the first to third embodiments described aboveuses a CCD image sensor 141, but the invention is not so limited. Theimaging element may use a CMOS image sensor or an NMOS image sensor, forexample.

The image processor 160 and controller 150 may also be rendered on asingle semiconductor chip or on separate chips.

The display means in the first to third embodiments described above isan LCD monitor 110, but the invention is not so limited. An organic ELdisplay or inorganic EL display may be used, for example.

The display-image data is generated based on main image data in JPEGformat in the first to third embodiments described above. However theinvention is not so limited. The display-image data may be generatedbased on YC data or RAW data from which the main image data isgenerated, for example. This configuration enables generating thedisplay-image data in the process of generating the main image data, andtherefore can simplify the generating the image data. That is, thedisplay-image data can be generated based on the main image data or theimage data that is source of the main image data, for example.

INDUSTRIAL APPLICABILITY

The invention is related to a method of generating, reproducing, andtransmitting image files containing other display-image data in additionto or instead of thumbnail image data. Therefore the invention can beapplied to devices that produce, display, and transmit images. Forexample, the invention can be applied to digital still cameras, moviecameras, and cell phones with a camera function.

The invention being thus described, it will be obvious that it may bevaried in many ways. Such variations are not to be regarded as adeparture from the spirit and scope of the invention, and all suchmodifications as would be obvious to one skilled in the art are intendedto be included within the scope of the following claims. The presentdisclosure relates to subject matter contained in Japanese PatentApplication Nos. 2007-274999 filed on Oct. 23, 2007, and 2007-285001filed on Nov. 1, 2007 which are expressly incorporated herein byreference in its entirety.

1. An image file generating apparatus comprising: a main image dataacquisition unit configured to acquire main image data; a display-imagedata generator configured to generate display-image data based on themain image data or image data which is source data of the main imagedata; and an image file generator configured to generate an image filewhich includes a main header, the main image data, a display-imageheader and the display-image data, and in which the display-image datais stored in an area other than an area storing the main header, whereinthe main header stores main image information which is information onthe main image data and first display-image information which is imageinformation on the display-image data, the display-image header storessecond display-image information which is image information on thedisplay-image data, the main image information and the seconddisplay-image information share at least one item of image information,and the shared item of image information includes different valuebetween the main image information and the second display-imageinformation.
 2. The image file generating apparatus according to claim1, wherein the image file is configured to store plural pieces ofdisplay-image data, and the plural pieces of display-image data arestored in the image file in a predetermined order.
 3. The image filegenerating apparatus according to claim 1, wherein the image informationincluded in the first display-image information contains an item relatedto the shared item.
 4. The image file generating apparatus according toclaim 1, wherein the shared item is an item indicating number of pixels.5. The image file generating apparatus according to claim 4, wherein theimage information included in the first display-image informationcontains an item related to number of pixels.
 6. A method of generatingan image file comprising: acquiring main image data; generatingdisplay-image data based on the main image data or image data which issource data of the main image data; and generating an image file whichincludes a main header, the main image data, a display-image header andthe display-image data, and in which the display-image data is stored inan area other than an area storing the main header, wherein main imageinformation which is information on the main image data and firstdisplay-image information which is image information on thedisplay-image data are stored in the main header, second display-imageinformation which is image information on the display-image data isstored in the display-image header, the main image information and thesecond display-image information share at least one item of imageinformation, and the shared item of image information includes differentvalue between the main image information and the second display-imageinformation.
 7. The method according to claim 6, wherein the image fileis configured to store plural pieces of display-image data, and theplural pieces of display-image data are stored in the image file in apredetermined order.
 8. The method according to claim 6, wherein theimage information included in the first display-image informationcontains an item related to the shared item.
 9. The method according toclaim 6, wherein the shared item is an item indicating number of pixels.10. The method according to claim 9, wherein the image informationincluded in the first display-image information contains an item relatedto number of pixels.